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Abstract 

The authors explore the possible relationship between student satisfaction with online learning and the 
theory of psychological contracts. The study incoiporates latent trait models using the image analysis 
procedure and computation of Anderson and Rubin factors scores with contrasts for students who are 
satisfied, ambivalent, or dissatisfied with their online learning experiences. The findings identify three 
underlying satisfaction components: engaged learning, agency, and assessment. The factor score 
comparisons indicate that students in the general satisfaction categories characterize important differences 
in engaged learning and agency, but not assessment. These results lead the authors to hypothesize that 
predetermined, but unspecified expectations (i.e., psychological contracts) for online courses by both 
students and faculty members are important advance organizers for clarifying student satisfaction. 


Introduction 

From its inception, online learning has been confronted by concerns about quality from the 
established educational community and society at large (Carnaghan & Webb, 2007; Akdemir & Koszalka, 
2008). Often, in addressing these concerns students’ perceptions of their course experience becomes a 
surrogate for learning engagement in the context of satisfaction (Swan, 2001; Arbaugh, 2001; Richardson 
& Swan, 2003; Bolliger, 2004). Because contemporary students view information as a commodity which 
can be traded openly among a community of learners, collaboration becomes fundamental to a variety of 
educational outcomes (Shirky, 2010; Dziuban et al., 2013). 



Modem technologies are contributing to the dissolution of traditional classroom boundaries 
(Shirky, 2008). Students connect with their instructors and each other through modalities of almost every 
variety, greatly expanding avenues of communication. Norberg, Dziuban and Moskal’s (2011) 
development of a time-based blended learning model, for instance, modifies the instructor’s role (Liu & 
Hwang, 2010) in learning environments based on students’ synchronous and asynchronous learning 
preferences. The need for new and more authentic assessment techniques in addition to challenges to 
traditional educational structures (e.g. semester length time boundaries) raises issues about what 
moderates students’ academic expectations and satisfaction. 

Studies suggest that online students wish to decrease their ambivalence toward formal education 
by gaining some sense of a carefully delineated path to success (Dziuban & Dziuban, 1998; Dziuban, 
Moskal & Dziuban, 2000; Long, 2011; Young & Dziuban, 2000). Students prefer active, rather than 
passive learning environments, and, because they participate in a highly interactive world, they expect the 
same in their classes (Dziuban et al., 2003). Today’s learners require more outlets for creativity and 
collaboration which online learning environments can accommodate through a variety of instructional 
models that are provided anytime, anyplace. 

Researchers should not be surprised that identifying the defining elements for satisfaction has 
become much more dynamic and complex. The construct has multiple facets that tend to be stochastic as 
a particular course progresses. In this study, we attempt to clarify the underlying (latent) elements of 
student satisfaction in the context of overall course evaluation for students who respond positively to 
online experiences on end-of-course evaluation protocols. Feldman (1993) describes the assessment 
challenges we encounter as distributions of considerations when he argues that responses to survey 
questions provide only an estimate of the central tendency of an individual’s attitude or belief about a 
subject or object. Craig and Martinez (2005) summarize the issue: “in retrospect, it seems rather 
simplistic to think of attitudes as always being unidimensional. After all, who hasn’t experienced mixed 
feelings about people, places and things that we have encountered or visited in our lives?” (p. 1) 

Recent Studies on Student Satisfaction with Online Courses 

Multiple approaches define and assess student satisfaction. Rubin, Fernandes & Avgerinou 
(2013) extended research on the Community of Inquiry (Garrison, Anderson & Archer, 2000) which 
defines social, cognitive, and teaching presence as being essential to the student learning experience and, 
thus, student satisfaction. They determined that learning management system (LMS) features greatly 
impact perceptions of community according to the inquiry framework. In a related study, Mahmood, 
Mahmood and Malik (2012) argued that teaching presence plays the most critical role in how students 
evaluate online learning. 

The interaction construct plays an important role in both face-to-face and online learning 
modalities (Kuo, Walker, Belland & Schroder, 2013). In fact, many studies have found that both quantity 
and quality of student interactions are highly correlated with student satisfaction in almost any learning 
environment. However, investigators have noted that demographic and cultural considerations also impact 
the design of appropriate interaction techniques in online learning (Gonzalez-Gomez, Guardiola, Martin 
Rodriguez & Montaro Alonso, 2012). 

Ke and Kwak (2013) identified five elements of student satisfaction: learner relevance, active 
learning, authentic learning, learner autonomy, and technology competence. Kuo et al. (2013) determined 
that learner-instructor interaction and learner-content interaction combined with technology efficacy are 
valid indicators of students’ positive perceptions. However Battalio (2007), using a criterion approach, 
argued that a positive course rating requires effective learner-instructor interaction. 

Keengwe, Diteeyont and Lawson-Body (2012) argued that students’ expectations influence the 
instructor’s design of effective technology tools in online courses and are the key to understanding the 
satisfaction construct. The authors concluded that satisfaction was most impacted by learning 
convenience combined with the effectiveness of e-leaming tools. Dziuban, Moskal, Brophy-Ellison and 
Shea (2007) found six key elements that contribute to students’ satisfaction: an enriched learning 



environment, well-defined rules of engagements, instructor commitment, reduced ambiguity, an engaging 
environment, and reduced ambivalence about the value of the course. 

Because colleges and universities have to be much more responsive to their student client base 
(Long, 2011; Bordelon, 2012; Allen & Seaman, 2013), ambivalence becomes particularly important. This 
implies satisfaction is an underlying indicator of success in various learning environments, especially 
online modalities. Satisfied students appear to be engaged, motivated and responsive; contribute to an 
effective learning climate; and achieve at higher levels. Dissatisfied or ambivalent students contribute to 
environments where instructors appear to have much more difficulty facilitating effective learning 
situations. Faculty members in such circumstances have trouble relating to their students and may 
incorrectly assume that such difficulties are related primarily to student dissatisfaction with online 
learning (Dziuban et al., 2007). 

A precise configuration of student satisfaction with online learning is proving to be elusive 
because it might be context dependent (e.g., college, discipline, course level, institution, and, of course, 
instructor). Bowker and Star (1999) use the term “boundary object” to suggest that these items or ideas 
adapt to specific needs and constraints while maintaining a common identity. While bringing a 
community of practice together for communication and inquiry purposes, they are generally are weak in 
the large cohort. According to these researchers, however, the object (student satisfaction, in this case) is 
much more well-defined within individual constituencies. These definitional issues appear to reflect what 
Watts (2011) calls confirmation bias—that is, accepting information that confirms our existing beliefs 
much more readily than information that does not. To express their degree of satisfaction, students react 
only to things that they expect, but are never expressly stated (i.e., their predetermined psychological 
contract) or to what they have already assumed about the course. However, should dissonance with these 
expectations develop, students may encounter ambivalence characterized by simultaneous positive and 
negative feelings. These are the mixed emotions described by Weigert (1991) and Long (2011). 

Factor Studies of Student Satisfaction with Online Learning 

A small number of studies conducted by investigators seeking to identify the dimensionality of 
student satisfaction with online learning have emerged in the past few years. This work has been a natural 
extension of inquiry into student satisfaction in higher education (Abrami & d’Apollonia, 1991; Feldman, 
1976; Feldman, 1993; Greenwald & Gilmore, 1997; Kim, Damewood & Hodge, 2000; Marsh & Roche, 
1997; McKeachie, 1997). While prior studies have focused primarily on face-to-face teaching 
environments, online learning has provided a new dynamic and has re-energized interest in the topic. 
Arbaugh (2007) adopted factoring methods to validate the Community of Inquiry framework (Garrison et 
al., 2000) incorporating social, cognitive, and teaching presences. He retrieved these primary constructs 
and demonstrated that they exhibited excellent reliability. His work extended the original Community of 
Inquiry framework to a fourth dimension: course design and organization. Stewart, Hong, and Strudler 
(2004), using principal components analysis, found a fairly complex underlying dimensionality that 
defines the pattern of student satisfaction in online learning: the evaluative construct for student involved 
issues such as web page appearance, hyperlinks and navigation facility, technical constraints, online 
applications, instructional techniques and expectations, content delivery, and the interaction environment. 
Bangert (2006) found four underlying elements related to the evaluation of online and blended courses: 
interaction, active learning, time on task, and student cooperation. In a later study, he validated his 
previous findings using both exploratory and confirmatory factor methods (Bangert, 2008). 

In a somewhat different approach to the identification of underlying dimensionality, Wang, 
Dziuban, Cook, and Moskal (2009) used classification and regression trees to predict student assessment 
of online courses and identified a series of validated if-then decision rules for predicting students’ 
perceptions of excellent teaching based on three constructs: facilitation of learning, ability of the 
instructor to communicate information and concepts, and the instructor’s respect and concern for students. 

Dziuban and Moskal (2011) conducted a study of the factor invariance in student satisfaction 
across online, blended, and face-to-face courses. Using Guttman’s (1954) image analysis, they found a 
single general component that remained constant across all modalities. The authors concluded that 



students do not use the modality of a course to differentiate elements of excellent instruction and course 
satisfaction. 

In a later study, Dziuban, Moskal, Kramer and Thompson (2013) used the alpha factoring 
procedure (Kaiser & Caffery, 1965) to identify the underlying dimensionality of satisfaction under 
varying conditions of student ambivalence toward their online courses. Using overall satisfaction with the 
course, they classified students into five categories: negative non-ambivalent, negative ambivalent, 
ambivalent, positive ambivalent and positive non-ambivalent, corresponding with the 5-item Likert scale. 
By factoring the remaining items of the instrument stratified by those categories, they found the highest 
dimensionality for students in the ambivalent categories and the lowest dimensionality in the non- 
ambivalent classifications. The factors in the extreme categories (either positive or negative) were 
identical as were the factors in the positive ambivalent and negative ambivalent categories. The authors 
hypothesized that the students who appear to be least engaged in their courses (i.e., ambivalent) may be 
the most reflective and thoughtful about evaluating their educational experience. 

Psychological Contracts as a Basis for Understanding Satisfaction 

By definition, factor analysis studies imply latent dimensions-constructs that cannot be directly 
observed. Therefore, the underlying components identified in these kinds of studies relate closely to 
Argyris’s (1960) notion of a psychological contract. These contracts are formed by implicit understanding 
and are not bound by written or legal agreements of two parties within a reciprocal relationship. They 
consist of perceived obligations and expectations, and thus, are subjective and vary from person to person 
(Bordia, Hobman, Restubog, & Bordia, 2010). When broken, or breached, (due to perceived unfairness, 
inequality, or mistrust), satisfaction and performance decline and workforce turnover increases, 
consequently impacting attitudes and behaviors (Bordia et al., 2010). 

All workplace psychological contracts contain six features: voluntary choice, mutual agreement, 
incompleteness, presence of numerous contract makers, plan for managing unsuccessful contract losses, 
and a relational model between employer and employee (Rousseau, 1990). Relational, transactional and 
balanced define these six features contained within three different types as outlined by Rousseau (1990). 
Relational agreements are based on loyalty and stability and, thus, foster satisfaction (Raja, Johns & 
Ntalianis, 2004). Transactional agreements include fewer duties, are usually temporary or short in 
duration, and usually result in behaviors that align or are consistent with the contributions in which one is 
rewarded. These contributions are economic in nature and viewed as less significant. The balanced 
agreement: a hybrid contract that is generally open-ended includes a mutual concern between both parties, 
but with clear expectations (Raja et al., 2004). 

When analyzing and assessing psychological contracts, the three forms of measurement include 
content-oriented assessment, feature and evaluation. The content-oriented assessment examines the 
obligations of the agreement; the feature-oriented assessment compares one agreement to another’s based 
upon attributes of the contracts; and the evaluation-oriented assessment assesses the degree of fulfillment 
and the amount of change that results (Rousseau & Tijoriwala, 1998). 

Psychological Contracts in Education 

Although Argyris (1960) developed the theory of a psychological contract for the workplace, the 
idea has important implications for educational environments. Wade-Benzoni, Rousseau, and Li (2006), 
for instance, contend that students view psychological contracts as a form of mutual exchange in the 
education process. The interactions between student and instructor are crucial and telling about ongoing 
perceptions of obligations (Wade-Benzoni et al., 2006). Often there is little to no explicit communication 
about these arrangements because they are informal and temporary. The power in the relationship within 
these contracts is predominately asymmetric, favoring faculty members who hold expectations about 
student performance and control resources such as grades, letters of recommendation, advice on careers, 
and, in some cases, dissertation research approval (Wade-Benzoni et al., 2006). 

Prior to viewing a syllabus, students begin to form expectations as they assess course offerings 
for academic development, decision-making input, challenges, feedback, and support (Spies et al., 2010). 



According to Spies et al. (2010), students pay close attention to the following categories: faculty, 
futuristic factors, student development, course and curricular content, learning opportunities, 
involvement, and facilities. These agreements tend to change and become more elaborate as the course 
progresses. 

Within a particular class, both students and faculty form a large number of contracts that present 
satisfaction challenges if, in the participants’ judgment, their implicit expectations are not met. This 
suggests that student satisfaction with online learning is, as Lakoff (1987) termed, a function of an 
idealized cognitive model—a construct fabricated to bring clarity and structure to a situation. Kahneman 
(2011) describes this thinking as “what you see is all there is.” Because of the complex interaction of 
these many constructs, however, student satisfaction with online learning appears to be an example of 
“there is much more than you can see directly.” 

The Survey and Sample 

The Research Initiative for Teaching Effectiveness (RITE) at the University of Central Florida 
(UCF) has been surveying UCF’s online students as part of an ongoing impact evaluation since 1996, 
when the university began offering Web courses. The longitudinal nature of the university’s examination 
of student attitudes has allowed for refinement and validation from the original survey. Ongoing 
evaluation allows researchers to accommodate rapid change in the online course environments and 
provide baseline data on items that may contribute to student satisfaction with these courses (Roberts, 
2007). 

Response rates for online surveys are always a concern (Sax, Gilmartin & Bryant, 2003). The art 
of a student survey is the development of an instrument that addresses the target, yet requires a minimal 
time to complete. The current RITE instrument focuses specifically on the dynamics of student 
satisfaction with online learning and is presented in a 5-point Likert scale format, ranging from strongly 
agree to strongly disagree. Items related to the learning management system or to technology itself have 
been excluded in an effort to minimize survey fatigue. Survey items were validated by examining their 
psychometric properties from previous surveys in terms of central tendency, variability, skewness and 
kurtosis, looking for anomalies, and for their relevance to the current state of the online initiative. 

Once the original item pool was selected the survey was developed using Google Forms 
(https://drive.google.com). Students were sent an announcement through the UCF Knights student email 
platform. Student directions included the purpose of the study, their rights as survey participants, and 
contact information for both the survey administrators and the University’s Institutional Review Board. 
Students were advised that the survey was open only to undergraduates 18 years of age and older, and 
were reminded that the survey was voluntary. Students were free to omit any question they were not 
comfortable answering or stop at any time with no penalty. Students received no rewards for participation 
and there were no risks for non-participation. All student data remained anonymous when aggregated. 
Overall 1,217 surveys were returned. 

An examination of student responses indicated that 84% of students represented the millennial 
generation, 72% were female, and 76% were unmarried. Almost half of the responding students worked at 
least 10 hours per week and data reflected the ethnic demography of the university, with 70% of students 
having a grade point average of at least 3.0. Respondents were experienced with online learning—97% of 
students indicated taking at least one online course, with a median of five online courses. Students were 
predominately upperclassmen, with 83% of respondents being juniors or seniors. The university has 
targeted the majority of its online offerings to the upper undergraduate level, thereby allowing for the 
transition of freshmen and sophomores to university life prior to extensive online learning. Our 
respondent sample of predominately upper undergraduates reflects this philosophy. Students who 
indicated they had not taken an online course were excluded from analyses, reducing the usable sample to 
1,197 responses. 



Methodology 


Reliability and Domain Sampling 

Prior to any analysis of the item responses collected in this sample, the psychometric quality of 
the information yielded by the instrument was assessed with validated techniques. Next, coefficient alpha 
(Cronbach, 1951) was used to determine the survey reliability. The psychometric sampling issue of how 
well the items comprise a reasonable sample from the domain of interest is an important aspect of 
analyzing constructs such as student satisfaction. Addressing this issue, Guttman (1953) developed a 
theoretical solution illustrating that the domain sampling properties of items improve when the inverse of 
the correlation matrix approaches a diagonal. Kaiser and Rice (1974) used this property to develop their 
measure of sample adequacy. The index has an upper bound of one with Kaiser offering some decision 
rules for interpreting the value of measure of sampling adequacy (MSA). If the value of the index is in 
the range .80 to .99, the investigator has evidence of an excellent domain sample. Values in the .70s 
signal an acceptable result, and those in the .60s indicate data that are unacceptable. MSA has been used 
for data assessment prior to the application of any factoring procedures. Computation of the MSA index 
gives the investigators a benchmark for the construct validity of the items. This procedure was 
recommended by Dziuban and Shirkey (1974) prior to any latent dimension analysis. An individual MSA 
for each variable gives the investigators an indication of whether or not a particular item belongs in the 
particular domain. 

Dimensionality of Student Responses 

The investigators sought to determine whether multiple dimensions underlie students’ satisfaction 
to their online learning environments. This is normally accomplished by the application of some version 
of the generalized factor analysis procedure. In this study the data were analyzed with Guttman’s (1954) 
image analysis. The procedure assumes that the data sets divide into two components. The first 
component is the portion of data that can be predicted from the remaining variables in the set (the image). 
The second component is the data that is not predictable from the remaining variables (the anti-image). 
The method is operationalized by predicting a standardized score on a variable for each individual from 
the remaining variables in the set. The image procedure derives underlying components found in the 
covariance matrix (the image matrix) of the standardized variables. 

The number of factors (components) retained in the final solution was determined by a procedure 
originally proposed by Dziuban and Shirkey (1993) and later validated by Hill (2011). The method 
involves the initial assessment of the dataset with the MSA followed by subsequent MSA computation on 
the matrix of partial correlations once the impact of the first, second, third etc. number of factors have 
been removed from the system. Once a value in the .60s has been reached, the majority of information 
from the system has been attained. The initial pattern matrix was transformed (rotated) according to the 
promax (Hendrickson & White, 1964) procedure. Pattern coefficients absolutely larger than .40 were used 
for interpretation purposes (Stevens, 2002). 

Once the final dimensionality of the data set was determined, factor scores for each subject in the 
sample were derived using the Anderson and Rubin (1956) method. These scores have a mean of zero and 
a standard deviation of one and are uncorrelated with each other. They also have a reasonably good 
relationship to the estimated factor validity. The final step in the handling of the data involved deriving a 
linear transformation of the standardized factor scores with T = (Z x 10) + 50 giving the scores a mean of 
50 and standard deviation of 10 for ease of interpretation. 

The scores for each factor were used as dependent measures for a rescaled comparison variable 
related to overall online course satisfaction. Because the number of dissatisfied students was small, the 
comparison variable was declassified into satisfied, ambivalent, and dissatisfied and used as a factor in 
the hypothesis test. The investigators were concerned with trends and effect size differences among the 
dissatisfied (4%), ambivalent (5%), and satisfied (91%) groups followed by Bonferroni post hoc 
comparisons (Hochberg, 1988). 



Results 


The promax transformed pattern matrix may be found in Table 1. The overall MSA for the 
variables set was .94 with an overall alpha reliability coefficient of .96. These values indicate excellent 
domain sampling and reliability. The individual MSAs indicate each item belongs to the family 
psychometrically. Upon extraction of three dimensions from the system using the Dziuban-Shirkey 
procedures, the MSA on the residual correlation matrix was .58 indicating that what remained in the 
system was essentially noise. 


Table 1 Pattern Matrix for the Promax Transformed Image Analysis 


Items 

Engaged 

Learning 

Agency 

Assessment 

MSA 

Generally, 1 am more engaged in my online 
courses 

.84 

.04 

-.07 

.94 

1 have more opportunities to reflect on what 1 
have learned in online courses 

.79 

-.05 

.04 

.94 

Online learning helps me understand course 
material 

.76 

.03 

.05 

.95 

There are more opportunities to collaborate 
with other students in an online course 

.67 

-.14 

-.03 

.93 

My online experience has increased my 
opportunity to access and use information 

.66 

.11 

.06 

.95 

1 am more likely to ask questions in an online 
course 

.65 

-.11 

.01 

.94 

Generally, 1 understand course requirements 
better in an online course 

.64 

-.09 

.19 

.96 

Because of online courses, 1 am more likely to 
get a degree 

.56 

.09 

-.03 

.94 

1 can manage my own learning better in online 
courses 

.54 

.18 

.17 

.95 

Take more online courses? 

.47 

.22 

.04 

.96 

1 am motivated to succeed 

-.12 

.56 

-.03 

.81 

I have strong time management skills 

.05 

.53 

-.07 

.85 

1 am a multitasker 

-.05 

.57 

.05 

.87 

Assessment of my academic progress is more 
accurate in online courses 

-.19 

-.04 

.56 

.92 

1 can more easily monitor my academic 
progress in online courses 

.14 

.11 

.51 

.92 

Response time from teachers and assistants is 
quicker in online courses 

.24 

-.12 

.43 

.94 


MSA = .94 
Residual MSA = .58 
Average Item Correlation = .70 
a=.96 

From Table 1, the reader may observe that the first factor appears very general, covering a 
number of issues associated with online courses ranging from engagement through willingness to take 



another online course. However, upon closer examination, it is clear what appears to be very general is 
quite specific in relation to what students evaluate in online courses. These elements include students’ 
abilities to engage, reflect, understand material, collaborate, find information, question, understand course 
requirements, manage their own learning, and increase opportunities for degree completion. This finding 
suggests students simultaneously evaluate multiple aspects of online courses to make decisions about 
their class experience. Furthermore, students may evaluate each element separately, especially when they 
are unsure of their satisfaction levels. We name this factor engaged learning (1A% factor variance) and in 
many respects, it conforms to Tolstoy’s (1878/2004) opening argument and Diamond’s (1999) contention 
that many elements must be accommodated if conditions are to be resolved satisfactorily. Conversely, any 
one or more of these elements might cause students to be less than satisfied with their educational 
experience. 

The second factor (17% factor variance) in the pattern matrix involves motivation, time 
management skills, and multitasking ability. This dimension suggests that students’ sense of agency —that 
is, students’ ability to initiate and control their own actions in the learning environment—plays a role in 
their satisfaction with their online learning experience. Students with a strong sense of agency assume 
responsibility for their learning and bring a sense of empowerment to their classes. Since the majority of 
students in this study indicated higher levels of satisfaction with online learning, we might reasonably 
assume they bring a higher sense of agency as well. Agency, however, may not be specifically related to 
course modality. 

The final factor (9% factor variance) depicts the manner in which the assessment process evolves 
in the online environment. Satisfied students are characterized by an ability to assess and monitor their 
progress, and indicate that a timely response by the instructor plays an important role in their satisfaction. 
Therefore, we find online students incorporate three dimensions into their evaluation process of online 
learning experiences: 1) engaged learning with various course elements, 2) a sense of agency, and 3) an 
efficient assessment of academic progress. 

The factor correlation matrix in Table 2 indicates that these student dimensions are highly and 
positively related in a generally satisfied population. This suggests that engaged learning, agency, and 
assessment factors form a highly interrelated lexicon for student satisfaction, with engaged learning most 
highly related to agency (r =.86) and agency most highly related to assessment (r =.77). 


Table 2 Factor Correlation Matrix 


Factors 

Engaged 

Learning 

Agency 

Engaged Learning 



Agency 

.86 


Assessment 

.59 

.77 


The average correlation among the factors in Table 3 is .74 when computed by the method 
developed by Kaiser (1958). Table 3 contains the means, standard deviations, and significance levels 
for the three sets of factor scores for the declassified overall satisfaction variable. In addition, the table 
contains the pairwise combinations that proved significant on the Bonferroni comparison and the 
associated effect size calculated by the method outlined by Hedges and Olkin (1985). The factor scores 
for engaged learning and agency lead to the null hypothesis rejection, however assessment did not. For 



engaged learning, dissatisfied versus ambivalent ratings produced an effect size of .53, dissatisfied versus 
satisfied ratings yielded values of 2.01, and ambivalent versus satisfied ratings equaled 1.43. Bonferroni 
comparisons for the agency factors showed two significant differences with dissatisfied versus satisfied 
ratings producing an effect size value of 1.03, while ambivalent versus satisfied ratings yielded .77. Each 
of the above effects sizes by most standards is considered substantial. 


Table 3 Factor Score Difference by Overall Satisfaction 


Factors Scores 

Dissatisfied (D) 

(n=46) 

Ambivalent (A) 
(n=56) 


Satisfied (S) 
(n=1016) 


X 

S.D. 

X 

S.D. 


X 

S.D. 

Sig. 

Engaged Learning 

33.63 

10.86 

38.92 

8.92 


51.59 

8.86 

.00 

Agency 

41.46 

11.27 

43.74 

13.84 


50.98 

9.15 

.00 

Assessment 

48.93 

9.24 

49.21 

8.56 


50.13 

10.19 

.63 

Significant Bonferroni Pairwise Differences 

Categories 


Engaged Learning 


Agency 

Assessment 

Dissatisfied vs. Ambivalent 


.00 



ns 

ns 

Dissatisfied vs. Satisfied 


.00 



.00 

ns 

Ambivalent vs. Satisfied 


.00 



.00 

ns 

Effect Sizes - Hedges ’ g 

Categories 


Engaged Learning 

Agency 


Assessment 

Dissatisfied vs. Ambivalent 

0.53 



0.18 


0.03 


Dissatisfied vs. Satisfied 

2.01 



1.03 


0.12 


Ambivalent vs. Satisfied 

1.43 



0.77 


0.09 



Limitations 

There are a number of limitations in this study. Initially it should be noted that the factors derived 
resulted from a one-time administration of the survey instrument during the semester. Therefore, the 
stability of the satisfaction factors over an entire semester has not been validated. Second, the study was 
conducted on individual item responses rather than scales. Although this has precedent in literature, single 
items with presumed low reliability can be problematic in factor studies such as this because of their 
instability. Third, many aspects of exploratory factor analysis involve arbitrary decisions, for instance, 
number of factors to extract, values for salience in the pattern matrix, rotational strategy, and naming the 
final dimensions. Fourth, online survey research using mass e-mailings to students has the possibility of 
introducing response bias into the data. This makes replication of studies much more difficult. Finally, 
although the investigators collected extensive demographic data on the responding students, there was no 
possibility for controlling for many of the student characteristics that might have influenced the results. 
This raises a more general limitation resulting from the ease with which survey instruments can be 
distributed in the electronic environment. This causes many students to suffer “survey fatigue” that can 
adversely impact response rates. 




Conclusion 


Student Satisfaction in the Online Environment 

From its inception, the Sloan-Consortium (now the Online Learning Consortium) established 
student satisfaction with online leaning as one of its founding metaphoric pillars. In doing so, the 
organization demonstrated a commitment to the student voice as a component for understanding effective 
teaching and learning. This commitment by the Online Learning Consortium resulted in two decades of 
research devoted to understanding how students define excellence in their learning space. Satisfaction 
with online learning is becoming increasingly important in higher education for a number of reasons. The 
most important is the rapid adoption of this teaching and learning modality in colleges, universities, and 
community colleges across the country. However, another mediating issue is the growing sense of student 
agency in the educational process. Students are able and do express their opinions about their educational 
experiences in formats ranging from end of course evaluation protocols to social networks of all varieties 
making their voice more important than ever before. 

Factor Studies 

Online learning has redefined student satisfaction research. It has caused the education research 
community to reexamine traditionally held assumptions that learning primarily takes place within a 
metaphoric container called a “course.” In reviewing the studies that address student satisfaction, from a 
factor analytic perspective, one point becomes obvious: this is a complex system with very little 
agreement. Even the most recent factor analytic studies have done little to resolve the lack of consensus 
about the dimensions that underlie satisfaction with online learning. This appears to be the factor 
invariance problem in full bloom, where differing contexts mediate how students relate to their learning 
experiences because a common prototype for online courses has been elusive at best. There exists the 
possibility that each course incorporates several unique characteristics that make it difficult to identity 
common factors that are robust across context. Although the results of these studies differ in how many 
and what dimensions constitute satisfaction, their unifying objective was the same: identify the 
underlying theoretical perspective of student perception of online learning. In addition, all of them 
subscribed to latent trait theory, recognizing that the important dimensions that students differentiate 
when they express their opinions about online learning are formed by the combination of the original 
items that cannot be directly observed—that which underlies student satisfaction. 

Psychological Contracts as a Lens for Student Satisfaction 

Very often theories developed in on one discipline inform work in another area. We contend that 
this is the case with the psychological contracts and factors that define student satisfaction with online 
learning. The theory of psychological contracts explains employee satisfaction through the perspectives of 
expectations for the work place and employee interactions. These contracts may be common across 
employees, for instance safety on the job, or they may be unique to individual employees such as 
promotion. The elements of the contract are implicit in that they are never formally stated, but they are 
assumed by the individual holding them to be mutually agreed upon between the employee and the 
employer. Of course, this may or may not be so. Most importantly, a violation of the psychological 
contract, either real or perceived, by either party, leads to workplace dissatisfaction. 

In factor analytic studies, items about student satisfaction with online learning correspond to the 
formation of a psychological contract. The survey responses are reconfigured into a smaller number of 
latent (non-observable) dimensions that are never really articulated by the students, but are, nonetheless, 
fully expected to be satisfied. Of course, instructors have contracts for students as well. Studies such as 
this identify the student psychological contact after the fact, not prior to the class, however, nothing 
prevents both from happening and/or a comparison of the two. The prior contract might be identified 
before the class and the satisfaction factors after the class. 



Table 4 Correspondence Between Satisfaction and Psychological Contracts 


Student Satisfaction 
Factors 

Student Voice 

Contract Features 

Contract Assessment 

Engaged Learning 

Agency 

Assessment 

“Facilitate my learning” 

“Recognize my abilities and 
accomplishments” 

“Let me know where 1 stand” 

Relational 

Balanced 

Transactional 

Evaluation Oriented 

Feature Oriented 

Content Oriented 


Table 4 depicts the relationship between online student satisfaction factors and the features of a 
psychological contract specified in the literature. Each factor translates into how it might be expressed in 
the student voice followed by a corresponding contract feature and an assessment strategy. Engaged 
learning, the largest contributor to the factor pattern, indicates that students expect instructors to adopt a 
facilitative role in their teaching. This dimension corresponds to the relational contract where the learning 
environment is stable and organized with a clearly delineated path to success. Assessment in this situation 
is evaluation oriented, indexing fulfillment and change (i.e., students achieving learning outcomes). 

The second factor, agency, characterizes satisfied students who recognize their abilities and 
accomplishments in a balanced contract arrangement that they assessed by the degree of agreement 
between them and the instructor (feature oriented). The final factor, assessment, corresponds to that 
transactional contract with its evaluation determined by the degree to which the obligations of the course 
have been met (content oriented). 

Although they have been developed in different contexts, workplace contracts and student 
satisfaction factors are similar. Both attempt to explain the underlying cause of satisfaction or lack 
thereof. Both are general and non-nonspecific, becoming more complex as the job, class, or classes 
evolve over time. They are limited in their scope and at best index a kind of average perception of the 
workplace or educational environment. Rarely are employees fully satisfied with their jobs or students 
completely satisfied with their classes. However, both contracts and factors frame blueprints for 
developing instructional design strategies that can improve learning climates. Online learning has 
unbundled the classroom and the same technologies have done precisely the same to the workplace: no 
longer are either bound by physical space. 

Perhaps in a more traditional time, psychological contracts (predispositions) and student 
satisfaction elements (post dispositions) were somewhat separate in their context and orientation. 
However, it seems clear that information and instructional technologies are migrating into the same 
orientation space. This makes the questions “What did you expect on your way in?” and “Now that you 
are finished, how was your experience?” part of the same climate assessment paradigm. By coalescing 
factors and psychological contracts, we might gain insights into more effective learning environments that 
are not possible when each theory is considered separately. Blending the two takes best features of both 
and results in something entirely new—something more than you can see in either theory. 
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